Model Selection

Quantitative Efficient Inference

# Quantitative Efficient Inference

Medgemma 4b It Q8 0 GGUF

MedGemma-4B-it-Q8_0-GGUF is a GGUF format model converted from google/medgemma-4b-it, specifically designed for image-to-text tasks in the medical field.

Granite 3.3 8b Instruct Q8 0 GGUF

This model is a GGUF format model converted from the IBM Granite-3.3-8B instruction fine-tuned model, suitable for text generation tasks.

Large Language Model

Gemma 3 12b It Q5 K M GGUF

This is a GGUF format model converted from google/gemma-3-12b-it, suitable for the llama.cpp framework.

Large Language Model

Mistral 7B OpenOrca Q4 K M GGUF

This model is a GGUF format model converted from Open-Orca/Mistral-7B-OpenOrca, suitable for text generation tasks.

Large Language Model English

Featured Recommended AI Models

AIbase

Empowering the Future, Your AI Solution Knowledge Base

English 简体中文繁體中文にほんご

© 2025AIbase